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GROUPS OF SOUTHERN, RURAL, PRESCHOOL CHILDREN, 
APPROXIMATELY HALF OF WHOM COULD BE CONSIDERED TO BE 
CULTURALLY DEPRIVED, WERE USEO TO TEST FOUR POSSIBILITIES. 
THESE WERE THAT (I) INTELLIGENCE MIGHT BE MODIFIABLE, (2) 
INTELLIGENCE COULD BE VIEWED NOT ONLY AS A SINGLE BEHAVIORAL 
DOMAIN, But ALSO as a NUMBER OF SUCH DOMAINS, (3) CULTURAL 
DEPRIVATION COULD IMPLY LOW LEVELS OF INTELLECTIVE 
FUNCTIONING WHICH RESULT NOT ONLY FROM LACK OF PRIOR 
STIMULATION BUT ALSO FROM INADEQUATE DISCRIMINATIVE TRAINING, 
AND €4) TRAINING MIGHT PROFITABLY BE GIVEN IN THE VARIOUS 
INTELLECTUAL REPERTOIRES IF APPROPRIATE PROGRAMS COULD BE 
CONSTRUCTED AND IF PRECISE REINFORCING CONTINGENCIES WOULD BE 
ARRANGED AND CONTROLLED BY MEANS OF AUTOMATED OEVICES. THE 
RESEARCH WAS DIRECTED BY FIVE QUESTIONS DERIVED FROM THE 
POSSIBILITIES CONSIDERED. THE CONCLUSIONS WERE— (I) ONLY 
QUALIFIED ANSWERS TO THOSE QUESTIONS CAN BE GIVEN, (2) THE 
DATA GATHERED RAISED AS MANY QUESTIONS AS WERE ANSWEREO, AND 
(3) THE POSSIBILITIES CONSIDERED WERE ONLY PARTIALLY 
SUPPORTED. (TO 
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PREFACE 

The research to be described in this report Is based In part on 
some earlier research which was conducted by Dr. James Holland. Dr ; 

B - F. Skinner , and me during the summers of 1960 and 1961. At that 
time we were attempting to develop several different discriminative re- 
pertoires in retarded children by means of matchlng-to-sasple pr esen ters 
and programs which were similar in many respects to those used in the 
present research. I am indebted to Drs. Holland and Skinner for the 
early development of this technique and for the Instruction they gave 
me in its use. 

The present research was to a large extent carried out as a group 
enterprise, and without the assistance of Drs. Earl Baughman and 
Grant Dahlstrom and their staff, it could not have been conducted. As 
early as I960, Baughman and Dahlstrom began to make contacts and to 
establish rapport with school officials, teachers, parents, and child- 
ren in northern Orange County. In 1961 they began their own project, 
the purpose of which was to study intellective, social, and personality 
development in southern rural children. Xt was in large measure be- 
cause of their work in this geographical area that 1 was able to 
establish the two kindergartens and two instructional laboratories at 
Bfland, North Carolina in the fall of 1962. 



All test administration during the academic years of 1962-63 and 
1963-64 was carried out by examiners on the Baughaan-Dahlstrom staff, 
and their salaries were paid from Baughaan-Dahlstrom project funds pro- 
vided by N.ItM.H. Most of the same examiners did the testing during 
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the academic years of 1964*65 and 1965*66. Their salaries, however, 
were paid from Office of Education funds. In general, the examiners 
were excellent, and 1 am indebted to Drs. Baughman and Dahls trom for 
assembling them and making them available to my project. My thanks 
also go to the examiners themselves. These include Sophie Martin, 
Barbara Nixon, Rosemary Funderburg, Eva Ray, Anne Spitsnagel, and 
Musia Lakin. 

A number of colleagues have been especially helpful in other 
phases of the research. Mrs. Kathleen Fink was extremely helpful 
in preparing the match ing*to-sample programs. The typewriter pro* 
grams were in large measure prepared by Frank Graham, Linda Motley, 
Robert Rudolph, Kathryn Calhoon, Mary Daniel, and Margo Murphy. During 
the first three years Dr. John DeLorge and Dr. Eugene McDowell carried 
out almost all of the matching- to*saaple training. During the fourth 
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year Joseph Walton, Robert Rudolph , and Kathryn Calhoon conducted the 
typewriter training. I am also indebted to Mr. Paul Carr, Dr. James 
Godfrey, and Dr. Marcus Waller. Mr. Carr as Superintendent of the 
Orange County Public School System was extremely supportive and help- 
ful administratively. Dr. Godfrey was also generous with his 
administrative assistance. On at least two occasions his action 

saved the project from being terminated prematurely. Or. Waller was 

$ 

very helpful in a number of ways. He aided greatly, for example, in 
re-designing and building the present metching-to-eemple presenters 
end related equ ip m en t. Dr. Weller was also my constant advisor on 
technical matters. 
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Finally, Dr# Lyle Jones and Dr# Douglas Schoeningar eade assy 
helpful suggestions la regard to the soalyaea of the date, and 1 wish 
to thank thee for their assistance# 
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PROBLEM 

Tiie question o£ modifiability of intelligence is or.ce more a 

♦ 

pertinent one. It is no longer only a theoretical question, however, 
but is one which has immediate and practical implications* Gre^t 
concern is now being expressed over economic poverty and its twin evil, 
cultural deprivation. Remedial action is being taken at all age levels, 
but greatest interest centers on the culturally-deprived preschool child 
and methods for raising his level of Intellective functioning. 

The question, of course, is not completely divorced from theory. 

Hunt (1961) points to a changing conception of intelligence. This new 
conception is that intelligence is not constant, nor is it necessarily 
doomed to develop in a fixed, unmodifiable way. He cites data to support 
the contention that intelligence and intellective development can be 
modified by means of environmental events. 

There is another changing conception of intelligence which has 
important implications. This is that intelligence need no longer be 
viewed as a single unidimensional entity capable of being described by 
a single measure or index, e.g. the I.Q., but might be described 
multi-dimens tonally. If this proposition were formulated in behavioral 
terms, intelligent behavior would be conceived of not as a single class, 
but rather a number of different classes or repertoires of behavior, 
and to make meaningful comparisons among people in regard to intelligence, 
one would sample and compare each of these repertoires. 

The question which now arises is how might one go about modifying 
the intellective repertoires of various kinds of people, particularly 
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of preschool children? One would certainly make use of nursery 
school and kindergarten teachers and give instruction In the verbal* 
perceptual* and numerical repertoires by direct verbal instruction and 
by example. Skinner (1961a* 1961b)* however* points out that many 
children move into adulthood with largely undeveloped repertoires be- 
cause the environment and the traditional educational agents are often 
unable to supply appropriately reinforcing contingencies. Thus* 
children do not necessarily grow up in impoverished environments in the 
sense that they are exposed to a restricted or inadequate range of 
stlmull y but in the sense that they never experience many of the 
contingencies necessary for the development of the fine discriminations 
entailed in intellective repertoires. This occurs because the con- 
tingencies are too subtle and too difficult for many parents and 
teachers to arrange and control. To remedy this situation* Skinner 
suggests the use of relatively simple teaching machines. 

Machines are* of course* only part of the answer. Used in con- 
junction with them must be properly conceived* coherently arranged 
programs* Such programs must not only effect intellective improve- 
ment during the preschool period* but oust also shape and strengthen 
those skills or abilities which are involved in the more global academic 
behaviors developed later in school. The general problem then is to 
determine whether or not programs and automated procedures can be 
developed which* when used in conjunction with normal kindergarten 
instruction, will produce greater Increases in the proficiency of pre- 
school children in certain basic intellective skills than will kinder- 
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gar ten experience alone. The skills to be investigated Include verbal 
comprehension, perceptual analysis, quantitative thinking, and spatial 
visualisation* A second aspect of the problem Is to determine whether 
or not the effects of the special preschool training in these basic 
skills generalise beyond the programs themselves or existing tests of 
these abilities and actually augment the later learning of academic 
subjects in school* 

OBJECTIVES 

In the preceding section, alternative formulations of intelligence 
and cultural deprivation were considered* Four major points were made* 
These were: (1) that intelligence might be modifiable, (2) that it 
could be viewed not only as a single behavioral domain, but also as 
a number of such domains, (3) that cultural deprivation could imply 
low levels of intellective functioning which result not only from 
lack of prior stimulation but also from inadequate discriminative train* 
ing, and (4) that training might profitably be given in the various 
intellectual repertoires if appropriate programs could be constructed 
and if precise reinforcing contingencies would be arranged and con- 
trolled by means of automated devices* 

It is the general purpose of this research to test experimentally 
the feasibility of these alternative formulations with groups of 
southern, rural, preschool children, approximately half of whom could 
be considered to be culturally deprived* The research was directed by 
five specific questions, and finding empirical answers to these 
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questions was the objective of the research* The questions are the 
following: 

1* Can Stanford-Binet I.Q.*8 and patterns of abilities as 
measured by the Primary Mental Abilities (P.M.A.) test be changed by 
kindergarten experience? 

2* Hill programmed discriminative training given in conjunction 
with normal kindergarten experience produce greater changes in Stanford- 
Binet I«Q« and P<H«A* quotients than kindergarten experience alone? 

3* Hew persistent are the changes produced by kindergarten 
experience and by kindergarten experience plus the special instruction? 

4* Are the changes produced related to original level of 
intellective functioning? 

5* Are the effects of kindergarten experience and of kindergarten 
experience plus the special programmed instruction sufficiently general 
in nature to influence later academic performance as reflected by school 
grades and by scores made on the Stanford Achievement Test? 

RELATED RESEARCH 

The relative importance of nature and nurture in the development 
of intelligent behavior is a controversy of long standing* Excellent 
reviews of this controversy , its theory, and its research have been 
published by a number of Investigators, including Jones (1946, 1954), 
Anastssi (1958), Hunt (1961), and Fowler (1962)* Research on the role 
of environmental influences typically has entailed assessing one of the 
following interventional procedures: (1) placing institutionalised 
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children or children from intellectually “poor” homes in foster homes , 

(2) giving training on intelligence test items or similar materials , 
and (3) giving broader social and cognitive training by means of 
nursery school and kindergarten instruction* 

The efficacious effects of foster home placement on Intellective 
development are well described by Burks (1928), Freeman, Holzinger, 
and Mitchell (1928), Leahy (1935), Skodak (1939), Skeels (1940, 1965) 
and Skodak and Skeels (1945, 1949)* Some of the problems inherent in 
this type of research are discussed by Jones (1946)* Despite these 
difficulties, the magnitude and direction of the effects, even in the 
face of complications which might be expected to attenuate them, are 
impressive and seem to justify the contention that environmental ex* 
perience should be viewed as an important determiner of intelligence* 

The two remaining interventional procedures entail the use of 
better controlled, or at least more completely specifiable procedures* 

The first of these, i*e* giving special coaching on specific test items, 
has been carried out by Greene (1928) and by Casey, Davidson, and 
Harter (1928)* The effects of such coaching, especially that carried 
out b$ Greene, seem surprisingly large and persistent* This was found 
to be true in some cases even when training was given on material similar 
to the test material rather than on the test itself* 

It seems surprising that such research was conducted for the most 
part to determine to what degree repeated testing (of which this was 
an extreme case) could contaminate intelligence test scores* Indeed, 



data cited by Thorndike (1923), Lincoln (1935), and Adkins (1937) do 
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show that X«Q, gains occur as a function of repeated testing. There 
seems to be little or no evidence, however , that such procedures were 
investigated to determine whether or «#**? «*h*w tia»« 

— - w mmawwva/ 

on cognitive development generally or on later academic achievement • 

Today such activities and materials constitute a major part of readi- 
ness training, e,g, Thelma 6, Thurstone's Learning to Think Series 
(1947, 1948, 1949). 

A final procedure entails giving broad training, e.g. social and 
motivational as well as intellective, by of nursery schools and 

kindergartens. The procedure here seems to be continuous with that of 

i 

the second, l,e, specific training on intelligence tests or on material 
similar to them, and present-day nursery school and kindergarten j 

activities often include such training. The history of research on the 
effects of nursery school or kindergarten experience on intellectual [ 

f 

development, however, more closely parallels that of the foster home j 

procedure, perhaps because many of the same investigators are involved. 

Early studies by Woolley (1925) and by Barrett and Koch (1930) suggested 
that preschool experience has a favorable effect on intellectual 
development. Research conducted by Hildreth (1928), Goodenough (1928), 
and Kawin and Hoefer (1931), however, yielded negative findings. During 
the late 1930's and early 1940's, Wellman and her associatesreported a 

t 

number of studies which yielded data supporting the contention that j 

nursery school and kindergarten experience could favorably influence 
the level of intellectual functioning. These include Skeels, Updegraph, 

Wellman, and Williams (1939), Wellman (1938, 1943, and 1945) and 






ERIC" 

* Atm '''niaiftifdift foTfmT ^ ^ ^via^iiirrmiwi 



mmtz mi asm 11 






T*- - T | v J T 7 ■ < 1 






T 



1 



7 



Wellman and McCandlm (1946). 
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Tht findings of this group were criticised severely by other 
investigators (e.g. Goodenough (1939, 1940), Goodenough end Msuer 
(1940) , end McNemar (1940) ) end ss a consequence the frequency with 
which Inter research of this hind was conducted was greatly reduced. 

It was, however, the highly controversial research of Schnidt (1946) 
and Kirk's (1948) devastatlngly critical review of her report which 
for all practical purposes rendered such research extinct for 
approximately ten years. Interestingly enough, it was Kirk himself 
(1958, 1962) and his colleagues (e.g. Gallagher (1963) ) who helped 
resurrect research on the effects c- early training. 

It is difficult to say what really brought about a renewed 
Interest in the area. Certainly the 1954 Supreme Court decision was 
important in bringing unequal educational and economic opportunities 
to the attention of the nation as a whole. Great concern has 
developed over one of the consequences of such inequities, namely 
cultural Impoverishment, and it is this which seems to have generated 
new research on the effects of environmental influences on intellectual 
development. 

As one might expect, much of the interest centers on the culturally 
deprived child and how to rehabilitate him. Since 1963 a number of 
excellent collections of papers have been published on this and re- 
lated top lc8 • These include A. H. Pas sow's Education in depressed 
areas (1963) , Compensatory education for cultural deprivation by Bloom, 
Davis, and Hess (1965), a collection by Frost and Hawkens entitled 
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«w dl»*dv«nt*g«d child (1966), Hechinger's Pre-school education today 
(1966) , and a three-volume collection by Webster entitled The dls- 
advantaged learner (1966 ) „ These collections by no means contain all 
the article# written in this general area, but they do accurately 
reflect the type of thinking and research now going on. 

A survey of this literature suggests that it is directed toward 
answering three general questions* These are: (1) who are the 
culturally disadvantaged, (2) how do they think, learn, or behave in 
general, and (3) what sorts of learning and motivational influences 
must be brought to bear in order to improve their condition ? 

In regard to the first question several rather clear characteristics 
emerge* Della-Dora (1962, 1963) , Havinghurst (1964), and Wltmer (1964) 
all agree that the culturally disadvantaged are for the most part 
the economically deprived* They usually hold the lowest paying jobs. 



reside in submarginal housing, often have improper diets, and frequent- 
ly suffer from inadequate medical attention* In addition, although 
Cultural deprivation can and does exist in all races, in all geographi- 
cal locations, and with all kinds of family structures, it occurs more 
frequently under some conditions than others* A higher proportion of 
non-whites than whites, far example, are culturally deprived* Simi- 
larly, there is a higher percentage (though not a higher absolute 
frequency) of cultural deprivation in rural than in urban areas* In 
keeping with this, there is a higher proportion in the South than the 
North, and finally, cultural deprivation seems to occur more frequent- 
ly in homes where the family is headed by a female instead of a male* 
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Next 9 what are the behavioral and motivational characteristics 
of the culturally disadvantaged? Many authors have suggested answers. 
— — — — ~~»e •*«> nusuwci \*?»jfi» iwo; , ueucscn <iyo 3 a, i% 3 b t 

1965* 1966 ) 9 Hess (1964, 1965), and Relssman (1962, 1963a, 1963b, 1964). 
They point out that the culturally disadvantaged child is usually slow, 
concrete, and has less well-developed language, perceptual, and m em or y 
skills* Such a child may be unable to sustain attention; he lacks 
environmental information; and he is often unable to use an adult as 
a source of information. Such a child's motivation for school is often 
low, and problems of discipline frequently arise. 

Finally , what must be dune to improve the culturally— deprived 
child '8 condition? All authors seem to agree that perceptual, memoric, 
attentions! , and verbal skills must be developed. The child must be 
exposed to a wide variety of environmental events. Stories and other 
verbal materials must be adjusted to the child's level and background. 
Because he is so concrete and interested in the here and now, his 
Introduction to more abstract concepts must be delayed. Hunt (1961, 
1964, 1966) suggests that early motivation might be lost if the child's 
behavior does not provide a degree of Incongruity which is attractive. 
Ausubel (1963) also suggests that intrinsic motivation might be use- 
ful. The logic of this procedure is that the culturally deprived 
child's motivation for learning will increase as he discovers that he 
can learn. All authors point out that the child must be respected. 

The teacher must in no way suggest that she does not expect high level 
performance, and ahe must not respond differentially to him because of 
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his social class. Both Sexton (1961) and Clark (1963) have spoken 
to this issue* Finally , the families of the children must be stimulated, 
and better understanding and rapport must be established between 




teachers and parents* 

During the past ten years a great many research and remedial pro* 
jects have come into being* Among these are the Higher Horizons Project 
and the Great Cities Project* These projects vary in their approaches* 
Some involve working with preschool children; others entail enriching 
primary and secondary grade curricula; finally, others involve special 
teacher training or working with parents* Because the research to be 
described in this report is concerned exclusively with the effects of 
special preschool procedures, many of the other studies are not 
directly relevant here* Moreover, of the large number of preschool 
studies now underway (Hess (1965b) lists 121 compensatory educational 
projects which in some way involve preschool children^ few have re- 
ported their results* A survey of those who have, suggests that the 
most relevant are those conducted by Gray and Klaus (1965) in 
Murfreesboro, Tennessee , by Weikart, et al (1964) in Ypsllantl, 

Michigan, by Bereiter (1965, 1966) at the University of Illinois, 
and by Blatt and Garfunkel (1966) at Boston University* 

Gray and Klaus worked with preschool Negro children from families 
having yearly incomes of less than $3000. The children were given in- 
tensive training during the summer and had weekly visitations by the 
teachers during the rest of the year* One experimental group which 
vent through two summers of training showed a gain of nine I*Q* points 
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(the initial Stanford-Binet I*Q. was 86; the final was 95) • A 
second group having only one summer's training gained from a mean 
Stanford-Blnet I*Q. of 91 to one of 96. The two control groups 
showed mean losses of from four to six points* Differential gains on 
the Illinois Teat of Paychollnguistic Abilities (l.T.P .A.) were also 
reported* All data reported were obtained during the preschool period; 
no changes which occurred after the children entered school were re- 
ported* 

Bereiter (1965) reports gains on the 1*T*P*A* and on the Stanford* 
Binet made by 15 disadvantaged Negro children* The children were given 
training by direct verbal instruction in language , reading* and arithme- 
tic* Stanford-Binet I.Q.'s increased from a mean of 93*7 to one of 
100*4 over a six-month period (December to June)* Impressive gains 
were also reported for several of the subtests of the I*T*P*A* No 
control group data were reported* 

Welkart* £t al (1964) using three- and four-year-old Negro child- 
ren report large differential gains on the Stanford-Binet during the 
first preschool year* but not during the second* Thus in what Welkart 
calls Wave 0* the experimental children gained 12*8 1*Q* points (from 
78*4 to 91*1) while the control group gained 7*2 (from 75*0 to 82*2)* 
During the second year* however* the experimental group lost 2*2 
points while the control group gained 2*4* Waves 1 and 2 f which were 
composed of children who were three years old when they entered the 
experiment^ showed similar trends* Thus* during the first year the 
experimental and control changes for Wave 1 were 11*5 (from 79*1 to 















It 



& 

p 






c 




o 










* 






M i MW a* 



T 



T 



I a i ft a Wafli .* rWbn * HT && i fttw , S&XiiA a s &n&fou ~ y 



L.ai Y^^ prU*!^! i «r < *^v w * i fr** * k>sgataisig. **q c'Avr 



‘1 



! i 



1 



•$ 

I 



► 3 



13 



12 

90*6) and -0.5 (from 78*3 to 77*8) respectively* During the second 
they were -1*7 and 2*3 respectively* Only £lrst year data were re- 
ported £or Wave 2* The mean changes for that year were 20*4 (from 
80*5 to 100*9) £or the experimental children and 3*5 (from 79*4 to 82*9) 
for the control* 

Blatt and Garfurikel (1965) conducted a very carefully controlled 
experiment on preschool groups composed of both Negro and white child- 
ren* The mean C* A* of the children at the start of the experiment 
was 3*2 years* Blatt and Gar£unkel £ound that the experimental groups 
showed increases in Stanford-Binet I*Q* , but the control group showed 
similar gains* Thus the £our successive mean I* Q. scores obtained 
over the three-year period from the experimental group were 92.6, 

99.1, 97. 7 i and 97*7* For the control group the mean I. Q. scores 
were 89*2, 91*9, 95*4, and 96*3* Because the differences were non- 
significant, Blatt and Garfunkel did not examine differences among 
experimental groups* 

In general the data reported in these studies like those conduct- 
ed during the 1930's and 1940's suggest that I* Q. Increases can be 
produced through the intervention of intensive preschool instruction* 
The statement must be qualified, however, to account for negative in- 
stances* Gains in T.*Q* are usually easier to produce at an early age 
than at a somewhat older one* They are also more readily produced if 
the initial I*Q. score is in the range of 75 to 80* Bereiter's study 
might supply the one exception to this, but unfortunately he does not 
report the data of a control group* Finally, differential gains pro- 
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duced by etrly preschool experience often dissppeer even when pre- 
school training is continued. 

A survey of the experimental procedures indicates that most in- 
vestigators used several tests, a number of which were conq>osed of 
subtests which yielded independent scores, nils appears to be an 
important new trend, perhaps reflecting increasing disenchantment 
with a single index of intellectual functioning. It also perhaps 
reflects an increased interest in behavior and behavioral repertoires 
£S££S* 

Only one study, however, that by Blatt and Garfunkel, reports the 
use of what might be called an automated technique in conjunction with 
Other preschool training procedures. Unfortunately, those investigators 
did not analyse their data in such a way as to permit an assessment of 
the procedure. Nevertheless, all investigators in a sense appear to 
have programmed their material. Training materials were usually 
ordered in difficulty, and most investigators presented their materials 
in rela: ively small steps. 

The studies were very useful in another way, namely in calling 
attention to the great caution needed in carrying out research of this 
kind and in interpreting results. Non* instructed control groups are 
difficult to set up and maintain, but they are essential for the un- 
equivocal Interpretation of experimentally produced effects. Similarly, 
in a pre- and post- test experimental design, children attending kinder- 
garten must not be tested for at least a month or six weeks after entering. 
If this is not done, post-test gains may be contaminated ;by the effects 
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of increased rapport with the examiners , by emotional adaptation and 
the like. Great care must be used in keeping examiners , raters, and 
in certain instances teachers and parents, uninformed as to the purpose 
and perhaps even the existence of certain experimental procedures. 
Finally, examiners should not know which children are trained and which 
are not. Only in this way can examiner and teacher bias be kept from 
influencing the data. 
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General Plan 

Xn northern Ocmuts Coyntv thgg» j*i»« #<% ■« ■ » *ai«<u«i •«>!. .< 

which contains one school* At Che beginning of the project in Septem- 
ber* 1962» two of the schools had all-white enrollments, and two b ed 
all Negro. It was our plan at Chat time to eatabliah kindergartens 
two schools, one ell-white end one all-Negro. Further, it was 
our plan to test all of the preschool children who were approximately 
five years old in these two school districts and then to establish in 
each of the two districts three groups of children switched on the 
basis of Stanfor. Binet I.Q. , chronological age, and sex. The mashers 
of one group in each district were not to be enrolled in the newly 
established kindergartens; the members of the other groups, however, 
were to be enrolled. In addition, the members of one of the two groups 
enrolled in each kindergarten were to receive special programed in- 
struction, while the members of the other wore to participate in 
operant conditioning experinents. This latter procedure was planned 
so that the ex a miner s and teachers would not know which children 
received programed instruction and which did not, so that all children 
would have approximately the asm amount of contact with the experi- 
menters, and ao that all children would receive essentially the same 
number of trinkets, charms, and pennies which were used as reinforcers. 

In general the plan proved to be feasible except for one difficulty. 
This was that almost all parents insisted on thsir children being allowed 
to attend the kindergartens. As a consequence the 
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control groups In both kindergarten districts had to be eliminated. 

Thi» left two groups of children In each of the kindergarten districts, 
i.e. a group attending kindergarten and receiving usual kindergarten 
instruction and one which would received special programmed instruction 
in addition to the kindergarten experience. In order to replace the 
control children in the two kindergarten districts, we decided to use 
the preschool children in the other two school districts, where kinder* 
gar tens had not been established. Therefore, all five-year-old child- 
ren in these districts reported to us by the school board were tested 
and put in the non-kindergarten control groups. Comparisons of data 
Indicate that in spite of the fact that these children were not selected, 
their match with the corresponding experimental groups was surprisingly 
close in respect to chronological age and Stanford-Binet I.Q. The six 

experimental groups and the training they received may be sunsarized 
as follows: 

White Children 

A. Kindergarten experience plus special programmed instruction 

B. Kindergarten experience only 

C. Neither kindergarten experience nor programmed Instruction 

Negro Children 

D. Kindergarten experience plus special programmed instruction 
B. Kindergarten experience only 

F. Neither kindergarten experience nor programmed instruction 
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One problem which arose and which will be discussed in detail 
later Is that the teachers sod the teaching methods of the schools 

Which the DOQ*l(isdsVffMftAn rhil Hl**n flH’Anrfail In aiiKa A niiAnf iva n«M 

apparently differed from those of the two schools where we had 
established the kindergartens. This made later comparisons of 
test scores and interpretations of performance differences more 
difficult* 



Testing Procedure 



Children entering the kindergartens were tested with the Stanford- 
Blnet and Primary Mental Abilities tests during the fall when they 
entered « or more precisely , they were tested from four to six weeks 
after they entered* They were tested again in the spring at the end 
of that preschool year* During the first three years of the project, 
children of the same age who lived in the school districts where no 
kindergartens had been established were tested by the same examiners 
during the same periods. During the fourth year, no preschool child- 
ren who lived in those two school districts which did not have kinder- 
gartens were tested* Those children living in the kindergarten 
districts and attending the kindergartens, however, were tested as 
usual. All children who entered the experiment before 1965 were later 
tested at the end of their first year in school* They were also tested 
at the end of their second year in school if they had entered the 
experiment in 1962 and 1963* The later follow-up testing entailed the 
use of not only the Stanford-Binet and P.M.A* tests but the Stanford 
Achievement test as well. The testing programs may be summarised 
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as follows: 



Testing Dates 

Children who Fall Spring Fall Spring Fall Spring Fall Spring 

entered 1962 1963 1963 1964 1964 1965 1965 1966 

kindergartens 
in 

Fall 1962 R R 1st 0 2nd 6 

Fall 1963 R K 1st 6 

Fall 1964 R R 

Fall 1965 



Non-kinder- 
garten child- 
ren who enter- 
ed experiment 
in 

Fall 1962 Pre-S Pre-S 1st G 

Fall 1963 Pre-S Pre-S 

Fall 1964 Pre-S 

Fall 1965 



2nd G 




1st G 


2nd G 


Pre-S 


1st G 



2nd G 
1st G 
R R 



All of the examiners were highly skilled and were very successful 
in evoking responses from shy, rural children. The Negro children were 
tested by Negro examiners, and the white children, by white examiners* 
The chronological ages, in years and months, of the children 
when they enter ec the experiment were as follows: 
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Mean 


Range 


White Kindergarten 


5 - 5.3 


4—11 to 5—11 


Negro Kindergarten 


5 - 5*9 


4—11 to 6—7 


White non-Kinder gar ten 


5 - 6.2 


5—0 to 6—1 


Negro non-Kinder gar ten 


5 - 6.2 


5—0 to 6—1 



Note that a few children were older than the legal school age when they 
first entered the kindergartens or when they were initially tested as 
non-kindergarten preschool children* 

In regard to the testing procedures it should be noted that .the 
examiners (and the teachers as well) knew which children attended 
kindergarten and which did not* This was due to the fact that kinder- 
garten children and non-kindergarten children lived in different school 
districts and attended different schools* Caution, therefore, is 
dictated in assessing the effects of kindergarten experience* On the 
other hand, none knew which child had received special programmed 
instruction &nd which had not* 

Attention must also be called to two other problems encountered 
in carrying out the testing* First, nine children were found to be 
unteatable at the time of their first preschool testing* If such 
children were enrolled in the kindergarten, they were allowed to 
continue* Most became testable at a later time, but none of their data 
were Included in subsequent comparisons and analyses* Second, 50 of 
the 371 children who had been tested during their respective preschool 
or kindergarten years were not tested at later scheduled times in the 
first and second grades because they had moved away* Twenty-six 
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of these had attended the kindergartens; twenty-four had not* Our 
solution to this problem was the seme as above, i*e* not to use any 
of thsir data in our sss lysss • Thu? * no data of a child Hers used in 
our analyses unless he was present for all of his scheduled tests* 



Operation of the Kindergartens 



The kindergartens were operated jointly by the U* So Office of 
Education project and the Orange County Scbool system* The salaries 
of teachers and teaching assistants were consistent with local pay 
scales* Their cost and the cost of major pieces of equipment were 
paid for by the project and by the IJniversity of North Carolina* The 
Orange County school system supplied the project with class rooms and 
school supplies* It also furnished transportation yia school buses 
and made available lunch room facilities* x 

The kindergarten children, although younger than their counter- 
parts enrolled in school, followed essentially the same schedule* 

They were picked up in the morning by the same buses which transported 
the school children and arrived for class at the same time, 8:30 a*m* 
Similarly, they left the kindergartens at 3:30 p*m* and were taken 
home by school bus* Again, precisely the same schedule was followed 
by the regularly enrolled school children* Because this seemed like 
an especially long day for such young children, most of their academic 
and special training activities were carried on in the morning with 
much of the afternoon being devoted to rest and play* 

All regular instruction in each kindergarten was carri jn by a 
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teacher and a teaching assistant. During the four year period three 
different teachers taught at each of the kindergartens. Because so 
many different teachers were involved in kindergarten instruction and 
because each developed noosuhat different programs, it Is difficult 
to describe the kindergarten curriculum el .ply. An analysis of the 
curriculum descriptions given by each of the teachers indicates that 
most teachers included the following activities s 

1. Training in verbal skills 

a* Teacher reading end telling stories to the dess 

b. Children dramatising stories 

c. Playing show and tell 

d. Letter recognition and printing 

e. Phonics, e.g. naming pictured objects snd noting slmilsrities 
in initial or final sounds 

f • Arranging sequences of pictures in order to tell a story 

2. Training in quantitative skills 

a. Counting objects 

b. Telling time 

c. Using the calendar 

d. Learning the concept of temperature snd hoe it is measured 

3. Training in science 

a. How plants grow, taught through pictures snd posters 

b. Names and character la ties of various animals, taught through 
use of similar pictures 

c. Concepts of movement 
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d. Concepts of weather 
4c Perceptual training 

a. Matching patterns and pictures 

o. Selecting odd or different stimulus and telling how it is 
different 
5 • Art training 

a. Using scissors, paint, crayons, and construction paper 

b. Listening to records 

c. Singing and using rhythm instruments 

Once more it should be noted that this list is not exhaustive 
nor does it represent the activities of any one teacher. It should 
also be noted that in general both the kindergarten curriculum and 
the type of instruction were traditional, and all instruction was 
carried out in the context of the school. 

Special Programmed Instruction 

Training procedure u9ed during first three years . Approximately 
one-half of the children who attended the kindergartens were given 
special programmed instruction. During the first three years this 
entailed the use of matching-to-sample programs and presenters. During 
the fourth year punched- tape controlled typewriters in conjunction with 
projectors and magnetic tape decks were used to present verbal programs. 
The matching-to-sample procedures required the making of discriminations 
of increasing difficulty. The program materials were in the form of 
35 am. Kodachrome transparencies • These had been prepared by 
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photographing appropriate [ .ctures , cardboard forms, mosaic patterns, 
letters, etc* The program slides, which ware projected, were presented 
by means of four -window consoles* It was the task of the children 
to match each sample stimulus presented in the top window of a console 
with one of three alternative stimuli presented in the three windows 
below it* This was accomplished by first presenting to a child a sample 
stimulus in the top window of the console* The child then pressed the 
top window* This opened the bottom shutter, exposing the three 
alternative stimuli which were projected on the three lower windows* 

If the child pressed the incorrect lower window, i*e* a window Which 
contained a non-matching stimulus, the bottom shutter closed, once 
more blocking the child's view of the three alternative stimuli in 
the l<*rer windows* It was the child's task then to press the top or 
sample window once again, exposing once more the three alternative 
stimuli* If the child then pressed the correct window, s buzzer 
sounded, a red light was momentarily activated, both the top and bottom 
shutters closed, and a new slide was automatically inserted in the 
projector* After approximately two seconds the top shutter opened auto- 
matically, exposing a new sample stimulus* The child then went through 
the same procedure* Stimulus presenters and programs of this type 
have been described previously by Skinner (I960, 1961), Holland (1961), 
and Htvely (1962, 1964)* 

During the first year the programs were constantly being revised 
in order to reduce the error rate* This does not mesn that difficult 
discriminations were removed but rather that additional slides, and 
thus additional discriminative steps, were put in the program ahead of 
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the ones previously found to be difficult* For various reasons some 
programs were completely eliminated and replaced by others* Those pro- 
grams Which were successfully edited and used In an unchanged form 
for at least two years are the followings 

1* Programs designed to Increase perceptual accuracy 

■ 4 

a* Matching pictures of flowers , fruit, animals, and people 
b* Matching letters 

c* Matching pictures of flags and pennants (in color) 
d* Matching pictures of flags and pennants (In black and white) 
e* Matching pictures of mosaic patterns 
2* Programs designed to improve verbal and perceptual skills 
a* Matching words 

b* Matching non-meanlngful letter sequences 
3* Programs designed to improve deductive and quantitative skills 
a* Matching pictures of groups of objects solely on the' baa Is 
of number In the presence of sometimes competing arrange- 
ments or configurations 

b* Matching on the basis of equivalent relations, e«g* one 
large blue square equals five small yellow squares, etc* 

4* Programs designed to improve spatial visualization 

a* Matching pictures of jigsaw puzzle pieces, often when 
sample or matching stimulus had been rotated 
b* Matching by Indicating which alternative would complete 
a figure 

5* Programs designed to improve inductive skills: matching by 
indicating which symbol or figure comes next in a sequence 
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Although the discriminative stimuli were all visual, the child 
was urged to supply and to use other stimuli and was assisted in this 

VAOJIf*d Kv flia Avnaw4«saa4*A« d«* a mm • _ 

'»» — -/ *“ • uwuuci of ways* me experimenter, for 

example, encouraged the child to tact the stimuli, i.e. to describe them 
verbally or name them out loud* Usually, the experimenter himself 
had to do this several times before the child began to do it. The 
experimenter also prompted the child from time to time if he ceased 
to verbalize the stimuli* This procedure was followed in an at temp t 
both to make the visual stimuli more discriminate and to add verbal 
mediation, additionally promoting the development cf verbal behavior* 

The experimenter interacted with the children in yet another way, 
namely, as a mediator of reinforcement* He showed the children the 
trinkets, charms, and pennies which they would earn by successfully 
completing a certain number of correct discriminations j and it was 
he who in fact later presented the reinforcers to each child* In 
addition, he supplied social reinforcement from time to time by 
saying “good" or some other socially approving work or expression 
when a child made a correct response* He also supplied aversive 
social stimuli, i.e* a disapproving word or expression, when a child 
made a mistake* The social interaction between the experimenter and 
the children was found to be helpful in reinforcing almost all of the 
children, but it was especially useful in the case of the Negro 
children, who often would not match unless the experimenter was pre* 
sent in the experimental rooms and intermittently supplying social 
reinforcement* 
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Training procedure used during the fourth year . During the 
fourth year the amount of time and effort devoted to matchlng-to- 
ssmple vas greatly reduced, only the four or five simplest perceptual 
programs being used* Instead, training was carried out with new 
programs and another type of auto** instructional device, one composed 
of a punched-tape controlled typewriter, a photoelectrlcally-cued 
magnetic tape deck, a 35 mm* projector, and associated circuitry* 

The technique resembled In some regards that described by 0* K* 

Moore (1963)* The programs were designed to give verbal training, 
e*g* echoing, tenting, tacting, and intraverballsing* The content 
areas covered by the seven programs used were the following: 

1* People, e«g* man, woman, boy, girl, child, husband, wife, 
mother, father 

2* Food, e*g* bread, butter, milk, banana, steak, hamburger, 
carrots, potatoes, strawberries, pie, ice cream 

3* Parts of the body, e*g* hair, nose, lips, teeth, eyebrow, 
arm, hand, leg 

4* Animals, e*g* horse, cow, dog, cat, lion, tiger, monkey, 
elephant, rhinoceros 

5* Professions, e*g* policemen, fireman, actor, judge, soldier, 
cook, teacher, farmer 

6* Actions, e*g* sitting, running, swimming, standing, washing, 
combing, sewing, cooking, reading 

7* Clothes, e* g* dress, pants, skirt, shirt, coat, raincoat, 
hat, scarf 
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The list of examples presented here with each program is by no 
means complete, only illustrative. Actually, each program contained 

ft (\ £i.(\ 4*1 «• _• AM Jl ^ 
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The programs were composed of three components. These were 
slides (35 mm, transparencies), verbal descriptions, definitions, and 
discussions recorded on magnetic tape, and punched tape sequences 
which were read into a memory and verifier circuit to determine 
whether or not the child made a correct or incorrrect typing response. 
Each program contained approximately 300 different slides and verbal 
descriptions. During a given program several slides and verbal 
descriptions were devoted to each word. These were always presented 
consecutively. The number of instances of each word varied from four 
to eight, depending on the length and meaningfulness of the word. 

The following procedure was used during this phase of training. 

A child sat at a typewriter where he saw a picture projected on a 
translucent screen. He heard a 30-second discussion read by the 
tape deck which described the important parts of the picture. As 
soon as the discussion had been completed, the taped voice said, 

"Spell DOG" (or the name of whatever object was being projected and 
eiscuased) • The taped voice then slowly said DOG with suffi- 
cient time between each letter for the child to echo what the voice 
had said. For many children, this slow rate of spelling was necessary 
only for the first time or two that a word was presented. After that, 
the child came to anticipate the spelling and did so before the taped 
voice finished spelling the word. The voice then said, "Say DOG", 
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and the child did to* Shortly thereafter , the voice Inatructed the 
child to type DOG* the child then did this, and on the completion 
of the laat letter, a buster founded, e bright rad light vat projected 
on the screen for three seconds, the slide changed, and the tape deck 
vaa started so that it began to read a new aeseage* If the child aade 
an error, the typewriter vaa automatically reset, and the child had to 
start that item over again* Thus, if the child typed DQX, the typewriter 
vaa reset, and the state of the verifier vaa changed so that D was the 
letter which had to be typed nest In order to be correct* The child 
might then type DOG and advance the slide, start the tape deck, etc*, 
or he night make an error and have to repeat the sequence* Usually, 
few errors were made so that the letter sequences did not have to be 
repeated very often* 

Our training sequences qualified as programs only in the sense 
that they presented the child with an orderly sequence of thematically 
related slides and recorded messages* Ho explicit fading of prompts 
or supplementary stimuli, however, was carried out* Thus, when the 
child spelled a word vocally, he was assisted by the echoic stimuli 
of the tape* Similarly , when he typed a word, he saw the letters 
projected on the screen together with an appropriate picture* An 
interesting thing, however, took place, i*e* many children effected 
their own fading* Thus, in the case of vocally spelling a given word, 
children often anticipated the spelling stimuli supplied by the tape 
deck after one or two presentations of a given word* Similarly, after 
they "copied" a word one or two times, they no longer looked at the 
screen when they were asked by the taped voice to type that same word 
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a third or fourth time* 

The reinforcing procedure used during the fourth year also 
differed goaswhat use that of the preceding years* As before, when- 
ever a child aade a correct response, i.e. typed a word correctly, a 
husser sounded, the screen was illuminated with a red light, and a new 
slide was projected, but because in this procedure auditory stimuli 
were used, a new taped message was also read. A more inportant 
difference in the training sequences, however, lay in the introduction 
of a token-exchange reinforcement procedure. This entailed rein- 
forcing a child with a metal token for each word typed correctly. At 
the end of a session, the tokens could be exchangee for various kinds 
of toys and candy, or they could be inserted in an exchange device which 
gave the child a penny and a charm for every three tokens. The pennies 
could then be Inserted in vending machines which contained a large 
variety of trinkets. They could also be used to buy toys and candy, 
or they could be kept if the child so desired. The increased diversity 
of reinforcers was felt to be necessary because of the longer experi- 
mental sessions and their greater frequency. Similar token-exchange 
procedures have been reported by a number of investigators, e.g* 

Staats et al. (1962, 1964) and Blrnbrauer el. (1964. 1965). 
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Agajyglfl of Stanfoy ^-piyt T.Q.U- in Table 1 are presented the 
mean St*mford-Binet I.Q. *s obtained from those children who entered the 
experiment in 1962, in 1963, and in 1964* Scores were obtained from 
those who entered in 1962 and 1963 at four different times* These 
were: (1) in the fall of their kindergarten year (or their last pre- 
school year, if the children did not attend a kindergarten), (2) during 
the spring of that same academic year, (3) during the spring of the 
following year, i*e* at the end of their first year in school, and 
(4) at the end of their second year in school* Only the first three 
scores are available for those who entered the experiment in 1964* 

Also Included in Table 1 are the nuaibers of children in each subgroup 
and the grand means for all experimental conditions* 

Table 2 contains the mean differences between the scores obtained 
during the fall of the kindergarten or the last preschool year and the 
scores obtained during the spring of that same year* Table 2 thus 
reflects eay change occurring during the last preschool year as it 
relates to kindergarten experience and to kindergarten experience plus 
special programmed instruction* Table 3 contains the mean differences 
between the scores obtained during the fall of the kindergarten or last 
preschool year and those obtained during the spring of the first year 
in school* This table thus depicts any change which took place over 
two years instead of the one kindergarten or preschool year and indicates 
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its dependency on kindergarten experience and on kindergarten ex- 
perience plus special programmed instruction. Similarly, Table 4 
contains the mean changes taking place over three years, l*e* the kinder- 
garten year, the first year in school, and the second year in school* 

Tables 2, 3, and 4 also include F - and p - values for appropriate 
comparisons • 

The data of these tables yield the following information* 

(1) White children who attended kindergarten during their last 
preschool year showed consistently greater increases in Stanford-Binet 
I.Q. during that year than did white children who did not attend kinder- 
garten* The difference was not significant at the 5 per cent level or 
better for the 1962-63 group, but was significant for those children 
who attended kindergarten during 1963-64 and during 1964-65* The 
difference between the combined scores of all three waves is also signi- 
ficant* (The term waves is borrowed from Welkart and is necessary 
because the term years would otherwise be used in at least two different 
ways* In the present case the term wave refers to a group entering 

the experiment during a particular year* Thus, **ave I might refer to 
those children who entered the experiment in 1962* In the same way, 

Waves II and III would refer to those entering in 1963 and in 1964 
respectively* The expression combined over all waves means that the 
appropriate difference scores of all three entering groups have been 
combined*) These gains resemble those reported by Wellman (1943). 

(2) For the white children there are no consistent effects 
resulting from the special programmed instruction during the preschool year* 
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(3) Neither kindergarten experience nor the special programmed 
instruction differentially influenced the Stanford-Binet I.Q. *a of 
tills Ksgro children during ths prssdiccl ycsr» 

(4) Comparisons of white children at the end of the first grade 
show that those who had attended kindergartens consistently gained 
more over the preschool year plus the first year in school than did 
those Who had not attended kindergartens during their last preschool 
year* This effect » though consistent , is not statistically significant 
for any one wave* The effect is significant however, T;hen the data 
for all waves (Those entering in 1962, in 1963, and in 1964) are 
combined* Again the special programmed Instruction had no significant 
effect* 

(5) Changes demonstrated by the Negro children over the same 
two years were not influenced in any consistent way by either kinder* 

, garten experience or the special programed instruction* The Negro 
children in the 1963 wave showed a significant programmed instruction 
effect, but this is viewed S3 a chance effect in much the same way as 
was the significant reversed effect found for the program* instructed 
white children during the preschool year of the 1963 wave* 

(6) Mean changes in Stanford-Binet 1«Q* taking place over the 
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preschool year plus the first and second years in school were not in- 
fluenced by either kindergarten experience or kindergarten experience 
plus special programmed instruction* This was true for both Negro 
and white children* 
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Analysts of P.M.A . Total Quotient Scores - Table 5 contains the 
mean P.M.A. total quotient scores obtained f>?om the same groups whose 
Stanford-Binet I s Q* r s were presented in Table 1, As in the case of 
the Stanford-Binet data, four quotient scores were obtained from those 
children who entered the experiment in 1962 and in 1963, while only 
the first thr 3e were available for those who entered in 1964* Tables 
6, 7, and 8 contain the mean differences between the scores which 
were obtained at the successive test administrations. These data are 
arranged in the same way as the Stanford-Binet I.Q, differences which 
were presented in Tables 2, 3, and 4. The data presented in these 
tables yield the following information: 

(1) White children who attended kindergarten during their last 
preschool year consistently showed greater gains during that year 
than did those children who did not attend. The differences, however, 
are not statistically significant. No consistent changes of any kind 
were found to occur over the preschool year plus the first year in 

school and over the preschool year plus the first and second years in 
school. 

(2) No consistent programmed instruction effects were found in 
the case of the white children. This was true for the kindergarten 
year, the kindergarten year plus the first year in school, and the 
kindergarten year plus the first and second years in school. 

(3) The P.M.A. total quotients of the Negro children were in* 
fluenced to a greater degree by kindergarten experience than were those 
of the white children. Negro children who attended the kindergarten 
during their last preschool year, for example, showed significantly 
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greater gains during that year than did Negro children who did not 
attend* The differences were significant during the years of 1962-63, 
1963-64, and 1964-65, and for all of those waves combined- Consistent 
kindergarten effects were also produced over the preschool year plus 
the first year in jchool* The effect for all waves combined is 
statistically significant* Reversed effects were found over the pre- 
school year plus the first and second years in school, but the 
differences are not statistically significant* 

(4) Negro children who received special programmed instruction 
consistently gained more during the kindergarten year than did those 
who did not receive the instruction* The difference between the 
combined scores for all three waves is statistically significant* 
Similar effects were found over the preschool year plus the first 
year in school and over the preschool year plus the first and second 
years in school* When scores were combined over all waves, both 
differences proved to be statistically significant* 

Analysis of Verbal Quotient Scores . Table 9 contains the mean 
quotients made by the various groups on the Verbal Meaning subtest of 
the P*M*A* Tables 10, 11, and 12 contain the mean differences between 
the scores obtained at the successive testing sessions* These data 
yield the following Information: 

(1) In the case of the white children, neither the kindergarten 
nor the programmed Instruction had any consistent effect on the gains 
over the preschool year and over the preschool year plus the first 
year in school. A comparison of the combined gains over the preschool 
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year plus the first and second year In school, however, indicates 
a reversed effect, i*e* those who did not attend kindergarten 
gained significantly more than those Ho did. 

(2) Those Negro children who attended kindergartens showed con- 
sistently greater gains over the preschool year and over the preschool 
year plus the first year in school than did those who did not attend. 

In both instances the differences between the combined scores are 
statistically significant* No consistent kindergarten effects were 
found over the preschool year plus the first and second years in 
school* 

(3) Programmed instruction in the case of the Negro children 
produced no consistent changes during the kindergarten year* Con- 
sistent changes were produced, however, over the kindergarten year 
plus the first year in school, and the difference between the combined 
scores over all waves is statistically significant* Consistent 
differences were found over the kindergarten year plus the first 

and second years in school* None, however, are statistically 
significant* 

Analysis of Perceptual Quotient Scores * Table 13 contains the 
mean quotients made by the various groups on the Perceptual speed 
subtest of the P*H*A* Tables 14, 15 * and 16 contain the mean 
differences between scores obtained on successive test administrations* 
These data yield the following information: 

(1) White children who attended kindergarten during their last 
preschool year consistently gained less than those who did not* This 
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is true for the preschool year, the preschool year plus the first 



year In school, and the preschool year plus the first and second 

years in school • In fact, when the appropriate groups were combined 

• - ^ 

over six waves, those children who had not attended kindergarten were 
found to have gained significantly more over the preschool year plus 
the first year in school than those who had attended, 

(2) No consistent programmed instruction effects were found for 
the white children. 



(3) Those Negro children who attended kindergarten during their 
preschool year showed significantly greater gains over that year and 
over the preschool year plus the first year in school than did those 
children who did not attend kindergarten. The change was reversed 
over the preschool year plus the first and second year in school. 

None of the differences are statistically significant, 

(4) In general Negro children receiving programmed instruction 
during their preschool year shoved greater gains than did those who did 
not receive programmed instruction. The differences, however, are 
relatively small and for the most part not significant. This is true 
for all comparisons. 

Analysis of Number Quotient Scores , Table 17 contains the mean 
quotients made by the various subgroups on the number subtest of the 
F,M,A, In Tables 18, 19, and 20 are presented the mean differences 
in scores obtained on successive testings. These data indicate the 
following: 

(1) Those white children who attended the kindergarten during 
the preschool year gained consistently more during that year than did 
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those who did not attend kindergarten* The difference between the 
pooled scores of all three waves is statistically significant* Con* 
sis tent (though non-significant) kindergarten effects were found over 
. the preschool year plus the first year in school , but not ever the 

. * -L. 

'l 

preschool year plus the first and second years in school* 

(2) In the case of the white children, programmed Instruction 
produced no consistent effects for any of the comparisons* 

(3) Negro children who attended kindergarten during their pre- 
school year showed consistently greater gains over that year than those 
who did not* The difference between the gains combined over all waves 
is statistically significant* Changes over the preschool year plus 
the first year in school show no consistent effects* Changes over the 
preschool year plus the first and second year in school, however, con- 
sistently favor the non-kindergarten children with the difference 
between the pooled gains over all waves significantly favoring the 
non-kindergarten children* 

(4) Those Negro children who received programmed instruction 
during their preschool year showed consistently, but not significantly, 
greater gains over that year than did those children who did not 
receive the instruction* A comparison of the combined scores over ' 
fill waves shows that the children who received programmed instruction 
gained significantly more over the preschool year plus the first year 
in school than the non-instructed children* No consistent effects 
were found over the kindergarten year plus the first and second years 
in school* 
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Analysis of P.M.A» Spatial Q^otifata . In Table 21 are presented 
the mean quotient scores made on the spatial subtest of the P<>M.A, 
by the various subgroups* Tables 22, 23, and 24 contain the mean 
differences between the scores obtained at successive test administrations* 
These tables yield the following information: 

(1) Those white children who attended kindergarten during their 
preschool year consistently gained more than did those children who 
did not attend* This was true over the preschool year and over the 
preschool year plus the first year in school* The pooled data show 
that those who had attended kindergarten gained significantly more 
over the preschool year plus the first year in school than did those 
who did not attend* Reversed effects which were consistent, but 

not significant, were found over tae preschool year plus the first and 
second years in school* 

(2) The white children who received programmed Instruction con*' 

Sis tent ly gained less over the kindergarten year than lid those who 
did not receive programmed instruction* A comparison of the gains 
pooled over all waves shows that the children who did not receive 
programmed instruction during the kindergarten year gained significantly 
more than those who did* No consistent programmed instruction effects 
were found over the preschool year plus the first year in school or 
over the preschool year plus the first and second years in school* 

(3) Negro children who attended kindergarten gained significantly 
more over the preschool year than those who did not attend* The 
differences are statistically significant for the year 1963-64, for 
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the year 1964-65 , and for all waves combined. Ho consistent effects 
were found over the preschool year plus the first year in school. 
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preschool year plus the first and second years in school were shown 
by those children who entered the kindergarten in 1962-63 and in 1963-64. 

(4) No significant or consistent effects were found in the case 
of those Negro children who received programmed instruction. 

Summary and Interpretation of Results with Training Procedures Used 
in 1962, 1963, and 1964. 

The previous analysis and description of the data was carried out 
to call the reader's attention to each comparison and its outcome. Be- 
cause of its exhaustiveness, some of the major effects and trends were 
perhaps obscured, therefore, the comparison data have been reduced and 
combined into a single table. This has been done by using a single value 
to represent the outcome of all waves combined for a particular com- 
parison and by replacing the exact values of the comparison differences 
with one of seven indices. The indices are as follows: 

(1) -H* » A difference which is significant at the 1 per cent 
level in favor of the kindergarten groups (as opposed to the non- 
kindergarten groups) and in favor of the program-instructed groups 
(as opposed to the non-program-instructed groups). This difference 
is based on the total for all waves. 

(2) + » A difference which is significant at the 5 per cent 
level in favor of the kindergarten groups and in favor of the program- 
instructed groups. This difference is based on the total for all waves. 
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(3) C * A difference which is consistent, but not significant 
over all waves in favor of the kindergarten groups and the program** 

rtWAimo T«a #Ua aoaa *4P aMM«a«4sAAa mvai* fkn m^aaaIiaaI 

0* WW^« U • fait faUW VWUU VJk VI A«y W4 *0VMV VTt)* SUV* vwvuvv#* 

year and over the preschool year plus the first year in school, this 
means consistency over three waves* In the case of comparisons over 
the kindergarten year plus the first and second years in school, it 
means consistency over two waves. 

(4) 0 * No consistent difference over all waves, but the total 
for all waves is in favor of the kindergarten groups and the program- 
instructed groups. 

(5) 0- * No consistent difference over all waves, but the total 
for all waves is in favor of the non-kindergarten groups and the non- 
program-instructed groups* 

(6) C- • A difference which is consistent over all waves in 
favor of the non-kindergarten groups and the non-programmed-lnstructed 
groups. 

(7) - * A difference which is significant at the 5 per cent 
level in favor of the non-kindergarten groups and the non-program- 
instructed groups* This difference is based on the total for all 
waves. 

In Table 25 are presented the differences which have been combined 
and coded in the manner described above* Thea^ dita show the following: 

(1) In the case of the white children, the kindergarten signifi- 
cantly influenced the Stanford-Binet l*Q.'s but generally had little 
effect on the P*H*A* quotient scores* 
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(2) Programmed instruction hid virtually no effect on the 
Stsnford-Binet I.Q.'s or the PcM.A. quotient! of the white children. 



had no effect cn the Stanford-Blnet I.Q.'e but had a highly signifi- 
cant effect on the P»M t A* quotients. 



had no effect on the Stanford-Binet I.Q.'s but significantly in- 
fluenced the totals verbal 5 and number quotients of the P.M.A. 

(5) The differential gains produced by kindergarten experience 
in the case of the white children grew smaller over time and in many 
instances were reversed by the end of the second year in school. 

(6) The differential gains produced by kindergarten experience 
in the case of the Negro children also grew smaller over time. Al- 
though the effects were more persistent for the Negro children than 
they were for the white, they too were reversed by the end of the 
second year in school. 

(7) The differential gains produced by the programed instruction 
in the case of the Negro children did not follow the simple t emp oral 
course followed by the differential gains produced by kindergarten 
expertise. Significant gains, for example, often did not occur over 
the kindergarten year, when the training was given, but rather over 

the kindergarten year plus the first year in school. Moreover, although 
the differential gains had 'decreased by the second year in school , 
no revets ale occurred. 
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(3) In the esse of the Negro children s kindergarten exnerienoa 



(4) Programmed instruction in the cose of the Negro children 
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Relation of Changes to Original Intellective Level 

In the analyses just discussed, only the main effects were reported. 
Gains over the various years were analysed, however, set csly in regard 
to main effects but also in regard to original intellective levels. In 
almost every instance there was a significant levels effect, with those 
subjects initially scoring below the median gaining significantly more 
than those scoring above. 

These findings, however, did not seem interesting because they were 
precisely what one would have predicted, given what is known about 
regression toward the mean. In addition, the levels effect was based 
not only on the data of the kindergarten children and the children who 
received special instruction, but on the data of the children who did 
not attend kindergarten as well. To be sure, kindergarten effects 
were examined and reported, but the effects of major interest were 
those produced by the special instruction, and these did not involve 
the non-kindergarten children. What we were interested in, therefore, 
were the interactions between original levels and type of training, 
i.e. programmed instruction ga no programmed instruction. Such inter- 
actions would permit us to determine whether differences between program- 
instructed and non-program-instructed children were greater for those 
children who initially scored below the median or greater for those who 
initially scored above. 

When the date were analyzed, only one such interaction was found 
to be significant. This interaction was for the Negro children and 
was for gains made on the P.M.A. total quotient over the kindergarten 
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year plus t : .„ first year in school. After finding this significant 
.interaction, we carried out separate analyses on the gains made by 
the children who were initially above the median of the P.M,A, 
total quotients and by those who were initially below. This yielded 
the finding that the children initially above the median who received 
both programmed instruction and kindergarten experience gained signi- 
ficantly more than those who had received only kindergarten experience 
(P * 12.98, df • 1 and 33, p< .01). In contrast, no such significant 
difference was found for those children who initially scored below 
the median (P » 1.35, df * 1 and 33, p<0.25). 

Two comments regarding this finding seem indicated. First, the 
programed instruction effect for the Negro children on the P.M.A. 
total quotient over the kindergarten year plus the first year in 
school was our largest and perhaps our most reliable effect. Had 
the effects on the subtests been larger and more reliable, they 
too might have yielded significant interactions. 

A second point which must he made is that many of the Negro 
dhildren had very low initial scores on the P.fl«A., so low in fact 
that the test norms bad no values for approximately one-half of the 
initial raw scores. In these instances the raw scores were 
arbitrarily assigned a quotient value of 50. This procedure, though 
necessary for data comparison, had the possible disadvantage of re- 
ducing our gains, particularly in the case of the subjects who had 
initially very low scores. This possible underestimation of the 
gains made by the Negro children who initially fell below the median 
also might have produced the significant interaction and thus 
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complicated our i erpretation of It* 



Effects of Kindergarten Experience and of Programmed Instruction on Later 
Academic Performance 



A question raised earlier is whether or not kindergarten 
experience and kindergarten experience plus special programmed instruction 
would Influence later academic achievements Answers to this question 
were supplied by two kinds of data. These are Stanford Achievement 
Test scores and academic grades* 

The Stanford Achievement Test was administered twice, namely, in 
the spring at the end of the 1963*64 academic year and in the following 
spring at the end of the 1964*65 academic year* In general, it proved 
to be an unsatisfactory test for most of the children because of the 
complicated instructions* Therefore, it was not given in the spring 
of the 1965*66 academic year* 

In Table 26 are presented the means of the battery medians made 
by the various groups. Table 27 contains the differences among the 
appropriate groups together with corresponding F's and -values. These 
data indicate that programmed instruction during the kindergarten year 
had no significant effect on Stanford Achievement Test scores* In 
regard to kindergarten effects, they reveal what to us at the time 
seemed like unexpected outcomes* These are the following: 

(1) White children who had previously not attended kindergarten 
scored significantly higher at the end of the first grade and at the 
end of the second grade than did white children who had attended 
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kindergarten* 

(2) Negro children who had not attended kindergarten scored 
significantly higher at the end of the second grade than did those 
Negro children who had attended kindergarten* 

The general finding that the non-kinder gar ten children scored 
higher on the Stanford Achievement Test at the end of the first and 
second grades , while disappointing , is no longer surprising* It is 
very much in keeping with the declining gains and reversed effects 
seen in Table 25* The major disappointment with the Instrument is 
that it was too insensitive to detect any of the programmed Instruction 
effects in the Negro children which were reflected by the P *H*A* 

The second method by which school achievement was assessed was 
through the use of academic grades* Unfortunately, these too proved 
to be of little value, except perhaps to point up difficulties which 
often arise in their use* The first problem encountered was the 
unavailability of grades in the non-kindergarten schools* Obviously, 
comparisons of grades given by different teachers at different schools 
are of limited value at best, but their unavailability in two schools 
eliminated any chance of comparison* Problems also arose in regard 
to grades given at the two schools which housed the kindergartens* 

For example, the cumulative grade records of some children were 
missing* Similarly, no grades were recorded on the cumulative records 
of some children* As a consequence, first-grade records of twelve 
children, for whom all other data were complete, were not available* 

In addition, nine second-grade records for similar children were 
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missing. Ibis left totals of .69 and 45 in the first an<£ second grades 
respectively of the white school and 62 and 37 in the same grade# at 
the Negro school* 

A somewhat less difficult problem that arose was how to arrive 
at appropriate indices which would summarize these grades. Arbitrarily 
this was done by combining grades in such subjects as reading and 
spelling into a single verbal score* A quantitative score was obtained 
by using the grade in arithmetic* Although other grades were given, 
it was felt that these two yielded a valid picture of each child's 
overall academic performance. 

In Tables 28 and 29 are presented the numbers of children making 
A's, B's, C's, and D's in the verbal and quantitative areas. 
Satisfactory grades are represented by A's and B's. A grade of 
C constituted a low pass* Failure in an area is signified by a 
D. Some instructors also gave E's and F's, but these grades had no 
official status according to the legend on the report card. Inasmuch 
as they too represented falling efforts, we pooled them with the D's. 

An inspection of the data of both tables quickly reveals that no 
significant differences were produced by the programmed instruction. 
This has been further supported by chi square tests. The only 
interesting aspect of the data is that the differences between the 
academic grades made by the Negro and white children parallel rather 
closely the differences found in their Stanford-Blnet and P.M.A. 
test scores. Note also that no Negro child in the first grade made 
an A in the verbal area during this three year period* 
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Analysis of Rssults Obtained With the Training Procedures Used in 1965 



Results obtained vlth the oatching-to-ssmple training during 1962 , 
1963 9 and 1964 , although gratifying in some respects, were disappoint- 
ing in others* The special instructional procedures, for example, had 
no ef£ec£*on any of the test scores of the white children* Similarly, 
they did not Influence the Stanford-Blnet I*Q* f s of the Negro children* 
Finally, they did not effect differential gains on the Stanford Achieve* 
meat Test or on academic grades* It seemed, therefore, that a 
modification of our procedure was indicated* 

In order to determine what modifications to make, we carried out 
more detailed analyses of our data* One such analysis entailed an 
examination of each item in the Stanford-Blnet test between the five- 
end eight-year levels* Tables 30, 31, 32, and 33 contain the results 
of this analysis* More specifically these tables present the numbers 
and percentages of children in each group passing each item* Table 30 
contains the data from the fiftl -year level* Tables 31, 32, and 33 
contain the results for the sixth-, seventh-, and eighth- year levels 
respectively* 

The data of Table 30 indicate few if any consistent differences 
between the various groups. An Inspection of Table 31, which contains 
the alx-year items, however, yields an immediately obvious difference. 
This difference Is between the Negro and white children on Item VI-1 
which is a vocabulary item* Fewer Negro children passed this Item 
originally, and their initial disadvantage was never completely over- 
come* The data of Tables 32 and 33 depict this difference even more 
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strikingly • Thus , on at least 10 of 12 items at the seventh and eighth 
year levels greater proportions of the White children than of the Negro 
children pass* This raises a question as to the nature of the items* 

It is difficult, of course, to specify their precise composition, but 
with the possible exception of Item VII-3 (copying a diamond) all entail 
verbal skills* Thus, to point out similarities or differences between 
objects the child must have developed both some general intraverbal 
skills and some competence in tactlng these objects* The same is true 
for comprehension and verbal absurdities* Even the memory item may be 
viewed as an assessor of intraverbal strength* It appears, therefore, 
that the relatively poorer performance of the Negro children might 
have been caused by the Increasing verbal demands made by the test 
items, which unfortunately were not met* In general it seems 
reasonable to consider this limitation as a possible basis for the 
poorer performance of all of the children on the test items at the 
higher age levels* 

In view of the results of our analyses ve decided to reduce the 
amount of training given by means of the matchlng-to-sample programs 
and procedures and to Institute training procedures which would give 
greater amounts of training in the various verbal skills* This was 
done by means of the typewriter complexes and programs previously 
described in the procedure section* 



Analysis of Stanford-Binet and P.M.A. data . Tables 34, 35, and 
36 contain the mean Stanford-Binet I*Q*'s and F.M.A* Quotients made 
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by the various groups. Is Tables 37, 38, and 39 ere presented the 
mean differences together with their appropriate F- end P- values. 

These date Indicate that neither In the case of the Negro children 
nor of the white children did the specie! typewriter instruction pro* 
duce gains which significantly differed from those produced by normal 
kindergarten experience. A ^"exam in ation of the raw data, however, 
indicated some unusual distributional properties, especially in the 
case of the groups not receiving typewriter instruction. In the case 
of the white children, for example, ell of the children receiving 
typewriter instruction shewed gains, in fact nine of the ten subjects 
showed galas of six or more I.Q. points. In contrast, only four of 
the control subjects showed gains of this magnitude. When a test 
of significance was performed on the distribution of changes above 
and below the median change, a significant chi square was obtained 
(X * 5.48, p < .02), thus Indicating that the typewriter Instruction, 
in conjunction with kindergarten experience, had produced significantly 
more gains beyond the median gain than had kindergarten experience alone. 

In Tables 40 and 41 are presented analyses of individual Stanford- 
Binet items from the fifth- through the eighth-year levels. These 
tables are identical to Tables 30, 31, 32, and 33 except that Tables 
40 and 41 contain data collected during the 1985-66 academic year. 

The data of these tables suggests that the typewriter training had its 
greatest effect on the Items of the eighth-year level. See especially 
the effect on Item VIXX-1, a vocabulary Item. 

When the chi square test was applied to gains on the P.M.A. Verbal 
quotients, essentially the same outcome was obtained. Again the children 
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receiving both kindergarten experience end typewriter instruction 
showed significantly more gains beyond the median than did those who 
received only the kindergarten experience « 3*94, p< .05)* In order 
to make certain that such differences were not present in the dat« of 
the first three years , we re-analysed in this manner the earlier Stanford-* 
Binet and P.M.A. Verbal gains of the white children* In neither case 
was statistical significance obtained* 

When chi square tests were applied to the other gains generated 
by the white children during the 1965-66 academic year, none were found 
to be significant or even to approach significance* Re-examination of 
the gains generated by the Negro children suggested no need for addi- 
tional analyses, indeed the effects of the typewriter procedure on 
the performance gains of the Negro children were very disappointing in 
a number of ways* Virtually, all gains produced by the typewriter 
were smaller than the gains previously produced by the matchlng-to- 
sample procedure* 

The results of these analyses strongly suggest that the type- 
writer procedure was appropriate for the white children* This is based 
in large measure on the fact that the typewriter procedure produced the 
first significant increases found in the white children and with the 
Stanford-Binet test* By the same token this same instruction seems 
less appropriate for the Negro children than does the matching-to-sample 
training* In the forth-coming year the matching-to-sample training will 
be reinstituted for the Negro children* Typewriter training will again 
be given, but will be delayed until they have completed the matching-to- 
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sample training* 

Analysis of specific achievement testa . Because we did not 
believe that the go re general s tandar d tests such as the S tanf ord* 
Blnet end P*H*A* were detecting all of the effects of the typewriter 
training, ve constructed and administered a number of highly specific 
achievement tests* Hr* Robert Rudolph had the principal responsibility 
for this endeavor, and the data which I shall report now are a part of 
those which he collected* 

One of the tests which Rudolph administered was a letter 
identification test* He found that those children who received the 
special typewriter instruction in conjunction with kindergarten ex* 
perlence identified slgnlflcently more letters than did those children 
who had only kindergarten experience* This was true for both the 
Negro children (t * 3*18 , p< *01) and the white children (t * 4*08, 

P< *01)* The same held true for an animal identification test with 
all experimental groups identifying significantly more animals than 
the controls* In this case the t for the Negro children was 2*97 
(p < *01); for the white children the t was 2*09 (p< *05)* 

These and similar data suggest that certain specific verbal 
repertoires were indeed influenced by the typewriter training* They 
also suggest that the Negro children profited from the training even 
though the Stanford-Blnet and P*H*A* tests did not reveal it* This 
outcome suggests that modifications must be made in the testing 
as well as the training procedures • 
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CONCLUSIONS AND IMPLICATIONS 

The reader at this point can probably supply only partial 
answers to the five questions posed in the section concerned with 
objectives* The reason for this is readily apparent* The answers 
are not simple but rather have to be qualified because the data which 
were collected raised almost as many questions as they answered* 
Therefore , it seems advisable at this time to take the answer to each 
question and examine it carefully. 

1* Can Stanf ord-Blnet I.Q.*s and patterns of abilities as 
measured bv the P.M.A* test be changed bv kindergarten experience ? 

The answer to this question is a qualified yes. It requires 
qualification because kindergarten experience significantly increased 
the Stanford-Binet I*Q. *s of the white children, but not those of the 
Negro children. In contrast, P*M.A* quotients of the Negro children, 
but not those of the white children, were significantly influenced by 
kindergarten experience* 

2* Will prog r^nwiAd discriminative training given in conjunction 
with normal kindergarten experience nroduce greater changes in Stanford - 
Binet I.Q. and P.M.A. quotients than kindergarten experience alone ? 

Again the answer is a qualified yes* The matching-to-sample 
training of the first three years had no effect on any of the test 
scores of the white children* The typewriter training given during 
the fourth year, however, produced significantly greater increases in 
Stanford-Binet I.Q. 's and P.M.A, verbal quotients than did kindergarten 
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experiences alone in the case of the white children* In contrast* the 
matching- to-s ample training given dosing the first three years produced 
significantly greater Increases in P.M.A. total* verbal* and 
number quotients in the case of the Negro children* It had no effect, 
however* on the Stanford-Binet I.Q.'s. In addition, the typewriter in- 
struction which had been so helpful to the white children, had no 
significant effect on the Stanford-Binet and P.M.A* scores of the 
Negro children* 

3* How persistent. are the chrn^ g produced bv kindergarten 
experience and bv kindergarten experience plus the special instruction? 

The significant gains produced in the white children by kinder- 
garten experience during the preschool year ware disappointingly short- 
lived, usually disappearing by the end of the first grade* More will 
be said about this later* 

Only the typewriter instruction* which was given during this 
past year* significantly influenced the scores of the experimental 
white children* It is impossible at this time, therefore, to assess 
the persistence of gains produced in the white children by special 
instruction because none as yet have completed the first or second 
grades* 

Kindergarten experience produced gains in the Negro children which 
appear to be more persistent than they were in the white children* Many 
gains, for example, were significant over the preschool year plus the 
first year in school* Closer Inspection of the gains found in the 
Negro children who received only kindergarten experience, however, 
Indicates that their gains in many instances were not significantly 
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larger at the end of the first year in school than were chose shown 
by the Negro children who did not attend kindergarten. Thus* much 
of the kindergarten - no-kindergarten difference was contributed by 
those Negro children who attended kindergarten and who in addition 
received the special programmed instruction. 

The gains produced in the P.M.A. quotients of the Negro children 
by the special instruction are perhaps the most persistent gains found. 
In fact the differential gains produced by the special instruction in 
the P.M.A. total, verbal, and numerical quotients were greater over 
the kindergarten year plus the first year in school than they were 
over the kindergarten year when the training was given. The effects 
thus not only persisted but also augmented learning during the first 
grade with the result that more highly significant gains were found 
over the two-year period than over the one-year period. 

4. Are the changes produced related to original levels of 
intellective functioning ? 

As was indicated earlier, when gains were analyzed in terms of 
original intellective level, those who were initially below the median 
of a particular test or subtest almost always gained significantly 
more than did those who were initially above. This, however, was 
anticipated on the basis of what is known about regression toward 
the mean and did not Interest us greatly. Our principal Interest 
was whether the special programmed instruction would have a greater 
differential effect on those above or those below the median of each 
test. Only one such interaction was found to be statistically 
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significant. This was the levels by pr ogr anxned - ins true t ion later- 
action for P.H.A. total -quotient gains over the kindergarten year plus 



t'ne iirst year in school. It was found with the Negro children but not 
with the white. Further analysis of these data indicated that a signi- 
ficant gain was made by those Negro children who were initially above 
the median but not by those who were below. It is our opinion that 
this finding must be considered tentative at this time* So many 
Negro children (approximately 50 per cent) had scores below the 
established norms that quotient gains for scores below the median 
might have been obscured, and the interaction might have resulted from 
this bias as a statistical artifact. 

Two additional findings seem relevant. First, the significant 
gains produced during the first three years of research were produced 
exclusively with the Negro children. Typically, the Negro children 
scored lower Initially than did the white children. It may well be 
that these gains were produced in the performance of Negro children and 
not in the white because of their initially lower scores and thus, 
their greater behavioral deficit. Secondly, significant gains were 
produced only in the white children during the fourth year of research 
when the typewriters were used. The typewriters and their programs 
perhaps required higher initial levels of intellective competence 
than did the matching-to-sample presenters and their programs. Thus 
the white children who scored higher initially (especially in the 
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requisite verbal skills) than did the Negro children are those who 
were helped. 
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Obviously, the reasoning which accompanies the last two findings 
is speculative. Nevertheless, it does not seem unreasonable to expect 
that certain kinds of training will augment the performance of those 
who make high scores Initially and that other types will assist those 
who make low scores. 

5. Are_ the effecta_of ki ndergarten experience plus medal 
orogranmiPd instruc tion sufficiently general in nature to influence 
later ac ademic per formanc e as reflected bv school grades and bv scores 
made on the Stanford Achievement Test? 

The answer at this time must be no. The academic grades of those 
children who received programmed instruction were not significantly 
different from those who did not receive it. Similarly, those children 
who attended kindergarten (and who in some instances received special 
programmed Instruction) did not score significantly higher on the 
Stanford Achievement Test than did those who did not attend kindergarten. 
As a matter of fact, those children who did not attend kindergarten 
scored significantly higher on the S.A.T. than did those who did 
attend. It seems sufficient to say at this point that neither 
academic grades nor S.A.T. scores were particularly sensitive and 
thsfc other measures of academic achievement must be used in the future. 




O 



The finding that the non-kindergarten children had S.A.T. scores which 
were significantly superior to those of the children who did attend 
kindergarten seems important enough to justify separate consideration, 
and it will be discussed shortly. 

Although tentative answers were obtained to the five questions 
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originally posed, four other inportanc questions as yet remain un- 
answered. The first of these is concerned with the level of cultural 
deprivation of the children studied. If one were to base his answer 
to this question on Stanford -line t I.Q.'s, one would have to say that 
most of the children were not more culturally deprived than children 
in general. This would follow from the fact that the initial mean 
Stanford-Binet I.Q. for the white children wee approximately 99 and 
that of the Negro children was approximately 90. It should be noted 
that a score of 90 would have exceeded approximately 66 per cent of the 
sample of five-year old Negro children studied by Kennedy jj.. (1963) • 

Other data, however, present quite a different picture. For 
example, in the case of the Negro children at the time of their first 
testing on the P.M.A. , approximately 82 per cent scored at or below 
the first percentile (of the national norms), and approximately 95 
per cent at or belcw the tenth percentile. The white children faired 
a little better. Approximately 25 per cent of them scored at or below 
the first percentile, and slightly store than 50 her cent scored at or 
below the tenth percentile. According to these data at leest 80 
per cent of the Negro children and 25 per cgqt of the white children 
might be considered culturally disadvantaged. 

Other data relevant to the issue are the total family incomes 
and the educational levels of the parents. Drs. Earl Baughman and 
Grant Dahls trom interviewed several hundred white and Negro families 
in northern Orange County in the course of obtaining data for their 
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project* I tm Indebted to them for allowing me to use these data from 
their unpublished manuscript (1967) . 

In regard to family income , Baughman and Dahls trom interviewed 
110 white families and 90 Negro families. They found that approximate- 
ly 15 per cent of the white families had annual incomes under $2500 1 
and 45 ggr cent under $5000. The Negro families earned considerably 
less. Fifty-four per cent earned less than $2500, and 92 pgr cent 
less than $5000. A conservative estimate of the percentages who were 
culturally deprived, based on these data, would be 15 pgr cent and 

54 pgp cent, but a more realistic estimate would be 45 ger cent and 
92 per ggn£. 

Two hundred and ninety-nine white families and 324 Negro families 
were questioned in regard to parental education. An analysis of these 
data Indicated that 31 per cent of the white mothers and 44 per cent 



of the white fathers had completed eight grades or less. Again the 
Negro families fared less well. Approximately, 49 pgr cent of the 
Negro mothers and 61 pgr cent of the Negro fathers had completed 
eight grades or less. Estimates here might range from 31 to 44 per 
gggp for the whites and from 49 to 61 pgr cent for the Negroes • 

All of these data suggest that some degree of cultural deprivation 
existed among bothifldtte and Negro children but that it was much more 
severe and widespread in the case of the Negro children than in the 
case of the white. This is of some significance in interpreting the 
data of the first three waves of children, l.e. those entering in 
1962, in 1963, and in 1964. It will be recalled that the matching*' 
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to-sample training in conjunction with kindergarten experience pro* 
duced significantly greater gains than kindergarten experience alone 
only in the case of the Negro children and only on the P.M.A. test* 

It may well be that such training is useful with just such a population 
and is of little value when levels of cultural deprivation are not so 
high. 

The data obtained with 1965-66 procedures, i.e. with the type- 
writers, also can be accomodated to this hypothesis* Thus, the white 
children showed significant gains on the Stanford-Binet and on the P.H.A. 
verbal scale whereas the Negro children showed no significant gains. The 
white children began the year with a mean I.Q. of 101 as compared to one 
of approximately 91 for the Negro children. Mean P.M.A. verbal quotient 
scores were approximately 85 for the white children and 78 for the Negro 
children. These data suggest that a certain minimal level of competence 
is necessary for this technique (at least as it was used during the 
past year) to raise scores. In terms of future operating procedures 
these results indicate that the more culturally deprived, and thus 
the less able, children should be well trained with the matching-to- 
8 ample programs before they are trained on the typewriter. For those 
who score higher initially, however, the matching- to-sample training 
might be omitted, and the typewriter training started immediately. 

A second question not originally posed but requiring discussion 
is one concerned with performance on the matching-to-sample progr ams 
and the relation of this performance to the test data. This question 
was not raised originally because of the fact that matching-to-sample 
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programs do not ordinarily yield data which are open to overall 
analysis • This results from the fact that most programs are revised 
from time to time, thus precluding the combining of data over years. 
One program, however, was prepared during the first year, and it was 
used in its original form throughout the three-year period* This is 
a program designed to teach inductive reasoning* Because this program 
was unchanged, because it was typically the last program in the se- 
quence of programs used each year, and because it generated errors 
in most subjects, we decided to analyse the data obtained with this 
program and to relate them to the test data* 

The Inductive program was composed of 237 slides, distributed 
equally in three trays of slides* In spite of the fact that the 
easiest discriminations were placed in the first tray, most of the 
errors occurred with the slides of that tray* Therefore, we decided 
to restrict our analysis to the performance data obtained with the 
first tray of Inductive slides* Our criterion of successful per- 
formance on the first tray of slides was to complete the 79 dis- 
criminations with no more than five errors* Host subjects did not 
meet this criterion on the first trial, but approximately 55 per 
cent of the white children did so by the second trial, and about an 
equal number of the Negro children did by the third* It was our be- 
lief that if performance on the programs in general and on this pro- 
gram in particular were related to test performance, there might well 
be significant differences between the test scores of those white 
children who reached the criterion in two or fewer trials and those 
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who required three or more. We also believed that there might be 
similar differences between those Negro children who reached the 

criterion in three or fewer trials and those who required four or 
more* 

In general , significant differences between the groups were found, 
but they were not as simple as had first been expected. In the case of 
the white children, that group which completed the first tray of in- 
ductive slides in two or fewer trials gained significantly more on 
the Stanford-Binet over the kindergarten year plus the first year in 
school than did the group which required three or more trials 
(13.90 vs 8.00; F * 5.54; df » 1 and 34; p< .05). In addition, that 
group which required two or fewer trials had a significantly higher 
mean P.M.A. total quotient score at the fall testing of the kinder- 
garten year than that group which required three or more (83.24 vs 
^ " 9.43, df * 1 and 34; p <«01). In the case of the Negro 
children, no Stanford-Binet differences were found. That group reach- 
ing the criterion in three or fewer trials, however, gained more P.M.A. 
total quotient points over the kindergarten year than did that group 
which required four or more (23.89 *§ 14.44; F * 7.38; df * 1 and 32; 

P < .05). 

These data indicate that performance on the programs is related 
to performance on the tests. Thus, in the case of the white children, 
those who successfully completed the 79 discriminations in two or 
fewer trials scored significantly higher on the first P.M.A. test than 
did those who required more trials. The data also suggest that gains 
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on the tests are related to performance on the programs. This 
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reached the criterion in two or fewer trials showed a significantly 
greater gain on the Stanford-Binet over the kindergarten year plus the 
first year in school than did those white children who performed less 
well, and (2) those Negro children who reached the criterion in three 
or fewer trials gained significantly more P.M.A. total quotient points 
over the kindergarten year than did those who performed less well. 

One final implication of the data not yet discussed is that 
there is some evidence that exposure to the programs may result in 
delayed gains even though performance on the programs is not good. 
Thus, in the case of the Negro children, that group which performed 
well on the program gained significantly more on the F.H.A. over the 
kindergarten year than did that group which performed less well 
(23.89 ys 14.44). The gain of 14.44 P.M.A. total quotient points 
made by the poorer performers was not significantly different from 
the gain of 14*51 points made by the Negro kindergarten children who 
did not receive programmed instruction* Over the kindergarten year 
plus the first year in school, however, both the good and the poor 
performers on the program gained essentially the same amount (33.72 
vs 32.50). Thus, those who performed well showed earlier gains while 
those who had performed less well showed later gains, and both groups 
showed significantly greater gains over the kindergarten year plus the 
first year in school than did those Negro kindergarten children who 
did not receive the special programmed instruction (33.72 vb 32.50 vs 
26.56). 
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A third question raised by the data is one concerned with the 
evaluative procedures* Until the fourth year of research we had been 
unable to influence significantly the Stanford-Binet I.Q.'s by means 
of our special instruction* We had influenced, however, the P*M*A* 
quotients* During the fourth year we significantly Influenced both 
the Stanford-Binet l.Q.'s and quotients on one P.H.A. sub test, namely 
the verbal sub test* This suggests that the Stanford-Binet teat at 
the fifth through the eighth-year levels is sensitive to changes in 
verbal skills but not particularly sensitive to changes in perceptual, 
spatial, and numerical skills* The P.M.A. test, on the other hand, 
seems sensitive to changes in all of these, especially if the initial 
levels of performance are relatively low* 

In addition, various tests, because of their format, mode of 
presentation, or motivational demands, seem differentially sensitive 
at various mental age levels* The Stanford-Binet requires responses 
which emphasize construction or composition* On the other hand the 
P.M.A* for grades K - 1 places greater emphasis on simpler recognitive 
and matching- type skills* It may well be that for the Negro children, 

f / 

whose mental age* were typically lower, the Stanford-Binet constituted 
a test which was insensitive to gains whereas the P.M.A* is one which 
was sensitive. The converse, however, may be true for the white child- 
ren* Thus, at the mental age-levels at which we were working, the 
Stanford-Binet may have been the appropriate test for the white child- 
ren, while the P.M.A. may have been non-discriminating* 

At other mental age-levels, especially where there is not such a 
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marked change £rom perceptual-motor to verbal skills, the Stanford- 

Blnet may be equally sensitive for both Negro and white children* In 

% 

this regard it should be noted that the P.M.A. for grades 2-4 became 
much more difficult and thus less sensitive for the Negro children than 
the P*M*A* for grades K-l had been* In almost every instance Negro 
children showed decreases in P.M.A. quotients when they were tested for 
the first (and only) time with the 2-4 version. A part of this loss 
almost certainly resulted from the loss of accumulated practice effects 
on th A K-l version* A greater part, in our opinion, was due to the 
sudden increase in difficulty* A better research instrument might have 
been a composite of the K-l and 2-4 versions* 

During the fourth year the Negro children showed significant 
gains on neither of the standardized tests, i*e., on neither the 
Stanford-Binet nor the P.M.A* They did show gains, however, on a 
number of specific achievement tests designed to assess the effects 
of particular programs* These later data, thus, indicate that the 
typewriter training did indeed have a salutory effect on the behavioral 
or cognitive development of the Negro children* Admittedly, the effects 
seem highly specific, but this may well be due to the fact that our 
achievement tests did not cover a broad enough spectrum of specific 
skills • Had they been more broadly conceived and covered a wider range 
of related verbal skills, the effects of the training might have proven 
to be more general* At the same time it must be admitted that the 
training procedures as well as the achievement tests probably need to 
be changed in order to gain more general effects* 
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A major implication of this line of reasoning is that more 
attention should be paid to the precise specification of the behavioral 
goals of the training. In the past the behavioral goals of such re* 
search have been to produce increases in scores on standardized tests 
such as the Stanford-Binet and P.M.A. Although useful, tests of this 
kind give rather gross pictures of the behaviors which are being changed. 
Achievement tests are required Which yield more detailed information 
about the changes of particular behaviors. Future research on the pro* 
ject will not exclude the more general standardized tests, hut efforts 
will be directed toward the development and use of specific achieve* 
ment tests which yield more detailed pictures of the behavioral changes 
produced by the interventional procedures. 

A fourth question raised by the analyses is whether or not the 
reversed effects found sometimes at the end of the first year in school, 
but more often at the end of the second, are related to kicrSesgroten 
experience. One possible answer is that they are and that kindergarten 
experience actually interfered with later academic achievement in 
school. Unfortunately, data are not available to refute completely 
this hypothesis. It seems improbable, however, on other grounds. 

The differential gains shown originally by the kindergarten 
children were probably due to the operation of a number of variables. 

Part of the gain almost certainly resulted from the experiences afforded 
the kindergarten children. Another major part, however, must have been 
due to increased rapport on the part of the children with the examiners 
and to favorable biases on the part of examiners and teachers toward 
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the children who had attended kindergarten. One might expect the 
effects due to differential rapport and examiner bias to disappear once 
all children had attended school for a time. One might also expect the 
effects of kindergarten experience to be lost in the first or second 
grade if instruction were uniformly poor and reinforcement infrequent. 
On the other haud , one would certainly not expect the reversed effect 
unless some additional variables were introduced and allowed to operate 
differentially. It is my hypothesis that this is what happened. 

Thus, in the first and second grades of the two schools where 
the kindergartens were located, instruction and motivation were notice* 
ably inferior to that at the other two schools, i.e. at the non- 
kindergarten schools. This observation was made both by members of 
this project and by -hose working on the Baughman -Dahls trom project 
as well. The effects of these differences are reflected not only 
in the reversed gains on the Stanford-Binet and P.M.A. tests but also 
by the significantly superior scores on the Stanford Achievement Test 
made in the first and second grades by the non-kindergarten children. 

The implications of these effects are important. First of all, 
they emphasize the difficulties inherent in assessing the longitudinal 
effects of various kinds of preschool training. . Secondly, they raise 
the practical question as to fruitfulness of giving preschool training 
without also upgrading instruction and motivation in all school grades. 
Clearly kindergarten experience and special instruction are helpful in 
raising intellective levels. Cur test data show this. Therefore, the 
new emphasis on preschool experience shonld not be given up. It cannot 
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take the place oi : good first and second grade instruction, however, 
and additional emphasis must also be placed there* 
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